Production Data Pipelines
Back to Home
01. Lesson Introduction
02. Extending Airflow with Plugins
03. Extending Airflow Hooks & Contrib
04. Demo 1: Operator Plugins
05. Exercise 1: Operator Plugins
06. Solution 1: Operator Plugins
07. Best Practices for Data Pipeline Steps - Task Boundaries
08. Demo 2: Task Boundaries
09. Exercise 2: Refactor a DAG
10. Solution 2: Refactor a DAG
11. Subdags: Introduction and When to Use Them
12. SubDAGs: Drawbacks of SubDAGs
13. Quiz: Subdags
14. Demo 3: SubDAGs
15. Exercise 3: SubDAGs
16. Solution 3: Subdags
17. Monitoring
18. Monitoring
19. Exercise 4: Building a Full DAG
20. Solution 4: Building a Full Pipeline
21. Conclusion
22. Additional Resources: Data Pipeline Orchestrators
Back to Home
14. Demo 3: SubDAGs
11 Demo 3 Subdags -
Next Concept